Goodness of Fit
Tools to assess goodness of fit
Maximum Likelihood
see Maximum likelihood estimation
Akaike Information Criterion (AIC)
where
Given a set of candidate models for the data, the preferred model is the one with the minimum AIC value.
Thus, AIC rewards goodness of fit (as assessed by the likelihood function), but it also includes a penalty that is an increasing function of the number of estimated parameters. The penalty discourages overfitting, which is desired because increasing the number of parameters in the model almost always improves the goodness of the fit.
BIC
where